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SUMMARY 

The  application  of  queueing  theory  to  the  performance  analysis  of 
store-and-forward  communications  networks  is  described.  Some 
basic  definitions  and  results  in  probability  theory  are  reviewed, 
and  the  important  concept  of  the  Markov  process  is  introduced. 
Applications  of  Markov  and  queueing  theory  to  the  study  of  networks 
and  network  components  in  equilibrium  are  taken  from  a  wide  range 
of  recent  research  literature,  with  the  emphasis  placed  upon  the 
formulation  of  the  mathematical  model,  rather  than  its  solution. 

The  author  feels  that  this  Review  should  prove  invaluable  to 
mathematicians  who  wish  to  gain  an  appreciation  of  the  power 
(and  limitations)  of  an  analytical  technique  that  occupies  an 
important  position  in  current  communications  research. 
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1.  INTRODUCTION 


From  its  beginnings  twenty  years  ago  with  the  ARPANET  experimental 
network,  the  evolution  of  packet-switched  communications  networks  has 
been  well  documented  [l,3]«  Landmarks  in  this  evolution  are: 

(i)  By  the  end  of  the  1960‘s,  plummeting  computer  hardware  costs 
implied  that  it  was  cheaper  to  allocate  communications  resources 
dynamically  (i.e.  as  a  switched  network)  than  to  install  extra  resources 
such  as  point-to-point  links. 

(ii)  During  the  1970’s,  the  introduction  of  standard  protocols  and 
the  concept  of  a  layered  architecture  made  it  possible  (in  principle) 
for  networks  to  be  designed  in  a  logical  way  and  to  be  interconnected. 

Although  the  individual  protocols  for  data  link  control,  flow 
control  and  congestion  control  may  be  easily  understood,  we  cannot  as 
yet  predict  the  consequences  of  their  interactions  in  a  network  subject 
to  errors  and  random  loading  over  a  period  of  time.  The  results  of  this 
ignorance  are  deadlocks  and  unnecessary  degradation  in  the  network 
performance. 

In  an  attempt  to  understand  network  behaviour,  much  work  has  been 
done  in  the  msthematical  analysis  field  by  American  groups:  Professor 
Leonard  Kleinrock  (University  of  California,  Los  Angeles)  and  Dr.  Martin 
Reiser  (IBM)  are  notable  examples.  Several  reviews  of  analytical  work 
exist  [4  j- [8  J . 

Because  the  traffic  offered  to  a  network  (and  perhaps  also  its 
routing  within  the  network)  is  random,  we  are  forced  to  resort  to  a 
description  of  the  network  characteristics  (such  as  throughput,  delay 
and  lost  traffic)  in  terms  of  probability  distributions.  (In  fact,  the 
idea  of  network  resource  sharing  is  based  essentially  on  a  result  in 
probability  theory,  namely  the  law  of  large  numbers:  although  the 
traffic  from  an  individual  user  may  be  bursty  in  nature,  the  total 
amount  of  traffic  from  many  users  is  likely  to  be  smooth  as  a  function 
of  time,  thus  leHing  to  an  efficient  use  of  resources.)  Markov  theory 
is  a  powerful  method  for  describing  the  stochastic  (random)  nature  of 
communications  networks,  as  it  leads  in  many  cases  to  tractable  models; 
nevertheless  it  can  only  be  applied  to  fairly  simple  situations,  so 
other  techniques  such  as  the  diffusion  approximation  are  being  employed 
to  treat  more  complicated  models  in  an  approximate  manner.  Finally, 
control  theory  has  been  used  to  investigate  the  control  of  networks, 
although  again  there  are  considerable  difficulties  in  obtaining  a 
tractable  but  realistic  model. 

In  Chapter  2,  various  definitions  and  results  in  probability  theory 
are  reviewed.  These  are  needed  in  order  to  understand  Chapter  3,  which 
concerns  itself  with  the  theory  of  stochastic  processes,  including 
Markov  processes,  queueing  theory  and  renewal  theory.  Chapter  4 
describes  the  applications  of  Markov  processes  and  queueing  theory  to 
the  performance  evaluation  of  protocols  and  network  components,  with 
examples  taken  from  current  research  literature.  In  Chapter  3  the 
limitations  of  queueing  theory  are  discussed  with  reference  to  blocking 
and  priority  in  networks.  Chapter  6  reviews  the  use  of  queueing  theory 
and  related  approximations  in  network  analysis. 

(The  material  in  Chapters  2  and  3  is  taken  in  part  from  Kleinrock’ s 
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2.  REVIEW  OF  PROBABILITY  AND  TRANSFORM  THEORY 


2.1  The  rules  of  probability 


We  consider  a  model  which  consists  of  three  entities: 

(i)  The  SAMPLE  SPACE  S,  which  is  the  set  of  mutually  exclusive 
exhaustive  outcomes  of  the  model  of  an  experiment.  Each  member  of  S  is  a 
SAMPLE  POINT. 

(ii)  A  family  of  EVENTS  E,  where  each  event  is  a  set  of  sample 
points.  An  event  corresponds  to  a  real  result. 

(iii)  A  PROBABILITY  MEASURE  P  which  maps  the  events  A  defined  on  S 
into  the  set  of  real  numbers.  It  satisfies  O^P  Al<1,  P[s]«1 .  Moreover, 
if  A  and  B  are  mutually  exclusive,  then  P[aUB]*P[a]+P| b]. 

The  CONDITIONAL  PROBABILITY  of  A  occurring  given  that  B  occurred  is 
defined  by 

P[AiB]  a  P[AB]/P[B]  (  for  P[b]*0  ). 

A  and  B  are  STATISTICALLY  INDEPENDENT  iff  P[AB]  -  P[a>[b]. 

Let  {At*}  be  a  set  of  mutually  exclusive  (i.e.  A;Aj »  ft  for  all  i,j, 
where  $  is  the  null  set)  and  exhaustive  (i.e.  A,U  A*U...U  A*-  S)  events. 
Then  this  set  satisfies: 

(i)  Theorem  of  total  probability: 

*  * 

P[b]  -  XPfAjB]  (  »2P[B}A;]p[Ai]  from  definition  of  conditional 

is>  tsl  probability) 

(ii)  Bayes'  theorem: 

P[A,  !B]  -  P[BU;]P[A<]  /  XPOjA;  ]P[A:  ] 

jxl 

Finally,  the  numbers  of  permutations  and  combinations  respectively 
of  N  objects  taken  K  at  a  time  are  given  by 

N!/(N-K)!  ;  "c*-  (J)  -  N!/K!/(N-K)» 


2.2  Random  variables 


(a)  A  random  variable  is  one  whose  value  X(w)  depends  upon  the 
outcome  w  of  a  random  experiment.  Define  the  event  [X"x]  *  |w:  X(w)«x| . 
Then  P[X»x]  is  the  probability  that  X(w)»x,  which  is  the  sum  of  the 
probabilities  associated  with  each  outcome  w  for  which  X(w)-x. 

The  PROBABILITY  DISTRIBUTION  FUNCTION  (PDF)  of  X  is 

£(x)  s  P[x<x],  where  [X<x]  »  jw:  X(w)<x} 

The  PROBABILITY  DENSITY  FUNCTION  (pdf)  of  X  is  £(x)  -  dFj;x)/dx.  The 
probability  of  an  event  occurring  between  x  and  x*dx  is  given  by  £(x)dx. 


Thus  we  have 


pfaOUb]  -  £#x)dx  -  F,(b)  -  ?J>a) 

The  joint  PDF  and  pdf  for  two  random  variables  X  and  Y  are 
F^x.y)  s  P[X<x,Y<y]  ;  ^(x,y)  5  d‘^(x,y)/dx/dy 

The  marginal  pdf  for  X  is  then  defined  by  £(x)  »  J^x,y)dy. 

(b)  Random  variables  . . .  t\are  independent  iff 

. <  - 

The  conditional  pdf  is  defined  by 

f^(xjy)  s  d/dx  P[x<xjY«y]  -  fy(x,y)/f^y) 

The  pdf  of  the  sum  of  two  independent  random  variables  X,  and  Xzcan 
be  shown  to  obey  the  following  rule: 

f4X(y)  *  f* ■  fx,(y)®fx/y^ 

where  $  is  the  CONVOLUTION  OPERATOR. 

In  general,  f^y)  -  ij{|(y)€)»»**€)fxj[y)  for  Y  -  X,  ♦  Xa*...+  X* 


2.3  Expectation 


(a)  The  expectation  of  a  random  variable  X(w)  is  given  by: 

Efx]  a  T  s  Jxf(x)dx  •  f[l-F(x)]dx  -  Jp(x)dx 
where  the  final  expression  is  obtained  by  integration  by  parts. 

If  Y  is  a  function  of  X,  i.e.  Y  ■  g(X),  then 

Eyhr]  -  Jytfyjdy 

Am 

If  ^(x)  is  known,  but  not  ^£y),  then  we  may  use  the  fundamental 
theorem  of  expectation: 

E^fY]  -  E*[g(X)]  -  Jg(x)#x)dx 


It  is  always  true  that  X  ♦  Y  ■  X  ♦T.  If  X  and  Y  are  independent, 
then  T T  «TT 

(b)  The  nth  moment  of  X  is  *X*  s  JV^xJdx. 


The  nth  central  moment  is  (X^T)*  e 


^(x-5r^x)dx. 


An  important  central  moment  is  the  VARIANCE  «iT*a  (X-X)*  ■  X1-  (X)1  . 
05  is  the  STANDARD  DEVIATION;  the  coefficient  of  variation  is  C*sqr/7. 
If  Y  •  X,  ♦  Xa*...+  X*  and  the  X{are  independent,  then  •?*•  f«  • 


The  COVARIANCE  of  two  random  variables  X  and  Y  is 
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Cov(X,Y)  *  (  X  -X )  ( Y  -  Y )  -  XY  -  XY 


2.4  Limit  theorems 


Let  |X« |  be  a  set  of  iid  (independently  identically  distributed) 
variables,  with  i  ■  1,...,n.  Define  the  "sample  mean" 

V*  -  j£xi/ n. 

Then:  hi 

(i)  P[|^-X!>x]  4  C^Anx1) 

(ii)  lim  ¥*■  Y  with  probability  one  (strong  law  of  large  numbers) 

(iii)  lim  P^x]  -  *(x)  (CENTRAL  LIMIT  THEOREM) 

H,  ^  A®  ^ 

where  Za  ( 1  fc/ff)  (.£ Xt  -  nX)  ;  *(x)  »  exp(-y*/2)dy  /J&r' 

«do. 

*(x)  is  the  NORMAL  DISTRIBUTION. 


2.5  The  role  of  transforms 


2.5. f  Introduction 

In  the  chapters  on  Markov  processes  it  will  be  shown  that  the 
probability  distributions  for  our  models  are  the  solutions  of  linear 
difference  or  differential  equations  with  constant  coefficients.  The 
standard  method  for  solving  such  equations  is  to  use  z-  or  Laplace 
transforms  respectively. 

2.5.2  The  z- transform 

(a)  Let  £.be  a  function  of  discrete  time,  where  n*0,1,2,...  .  The 
z-transform  F(z)  of  l^is  defined  by 

F(z)  s  £f.z\  where  z  is  complex. 

a** 

This  relationship  is  written  as  £d^F(z).  The  transform  exists  if 
there  is  an  a>0  such  that  lim  If*,! /a**  0. 

The  CONVOLUTION  PROPERTY  of  the  z-transform  is  f®  g<0>G(z)F(z) , 
where  •» 

Given  a  z-transform  F(z),  we  may  recover  the  sequence  f^by  two 
methods: 

f*  -  (1/n!)  d*F(z)/ dz*!,.e 

ffc  »  ( -2t r  j  )~*^F  ( z )  z-,'*d  z 

c 

In  the  second  method  (the  INVERSION  FORMULA),  the  closed  contour  C 
must  surround  all  poles  of  F(z);  the  Cauchy  Residue  Theorem  may  then  be 


applied . 

(b)  To  solve  the  general  difference  equation 


V*  w  *•*  *  **e* 


n  -  k,  k*1 ..... 


where  the  at  are  known  coefficients,  e^is  a  given  function  of  n,  and 
N  boundary  equations  are  given,  we  proceed  as  follows.  Multiply  through 
by  s  and  sun  from  k  to«s  i.e. 


1 

.mk  %wO  *** 


Then  pick  out  expressions  for  G(s)  in  this  equation  and  make  use  of 
the  boundary  conditions  to  eliminate  any  unknowns.  G(z)  may  then  be 
obtained  and  inverted. 

(c)  If  X  is  a  random  variable  and  g*,*  P[x-k],  then  G(z)  is  known  as 
the  probability  generating  function.  Note  that 

G(z)  -  E[z*]  ;  >G/3z!2b|  -  T;  ?G/>z‘ -  F-7 

2.5*3  The  Laplace  transform 


(a)  This  is  for  functions  of  continuous  time.  It  is  defined  by 

F*(s)  s  |  f( t)exp(-st)dt  ,  where  s  is  complex. 

We  write  this  as  f(t)<->Fts).  It  possesses  the  convolution  property 
*  ^ts)(fTs),  where  the  convolution  now  involves  integrals 
rather  than  sums.  Combining  this  with  the  result  of  Section  2.2,  we  have 
an  easy  way  of  obtaining  the  Laplace  transform  of  the  pdf  of  the  sum  of 
two  independent  variables. 

A  Laplace  transform  may  be  inverted  by  standard  techniques  such  as 
the  inversion  integral  method. 

(b)  To  solve  the  general  constant- coefficient  Nth  order  linear 
differential  equation 

awd*f(t)/dt*  ♦  ....  ♦  a,  df(t)/dt  ♦  a0f(t)  -  e(t) 

we  transform  both  sides  to  obtain  an  algebraic  equation  for  J^s), 
which  can  then  be  inverted. 

(c)  The  Laplace  transform  £(b)  of  the  pdf  of  a  random  variable  X 
may  be  written  as  Jfts)  ■  ETexpC-sX)].  The  moments  of  X  may  be  found  by 
solving 


d*^(  s)  /ds**’ ! 


(-i  rs* 


•! 


3.  STOCHASTIC  PROCESSES 


3*1  Definition  of  a  stochastic  process 


A  stochastic  process  is  a  function  X(t,w)  ■  X(t)  whose  values  are 
random  variables.  It  can  be  thought  of  as  a  family  of  random  variables 
"indexed"  by  the  time  t.  Both  X  and  t  may  be  continuous  or  discrete.  The 
relationships  of  the  X(t)  to  each  other  are  described  by  the  joint  PDF; 

Fx(x;t)  -  p[x(^)<x,, . for  all  x,  t,  n. 

X(t)  is  said  to  be  STATIONARY  if  it  is  invariant  to  time  shifts. 


Fx(x;t-T)  «  Fx(x;t)  , 
where  t+T  implies  the  vector  ( t,  ,  tx+  't , 


The  pdf  for  a  stochastic  process  X(t)  is  fx(x;t)  *  }F(x;t)/J3fc  . 

Then:  _  _•» 

X(t)  «  J  x  £(x;t)  dx  . 


3*2  Basic  queueing  theory 


The  arrival  of  customers  to  a  service  facility  is  an  example  of  a 
stochastic  process.  The  queueing  process  is  characterised  by 

Interarrival  time  PDF  ■  A(t)  *  p[time  between  arrivals  t] 

Service  time  PDF  »  B(t)  »  P[service  time  4  t] 

A  queueing  process  is  conventionally  written  as  A/B/m/K,  where  A 
and  B  are  the  interarrival  and  service  time  PDFs  respectively,  m  is  the 
number  of  servers,  and  K  is  the  storage  capacity. 

Let  A  be  the  average  arrival  rate  of  customers  to  the  system. 

If  T  is  the  average  time  spent  in  the  system  by  any  customer,  then 
the  average  occupancy  N  of  the  system  is  given  by  LITTLE’S  LAW: 

N  -  AT 

An  intuitive  "proof"  of  this  law  is  that  an  arriving  customer 
should  find  the  same  number  of  customers  on  average  in  the  system  as  he 
leaves  behind  on  his  departure. 

Let /u-  be  the  average  service  rate.  We  define  the  UTILISATION  FACTOR 
p  as  p  ■  (average  arrival  rate) x( average  service  time)  »  \/m  •  The 
system  is  stable  only  if  if/o>1,  the  number  of  customers  in  the 

system  will  grow  without  bound.  For  a  single-server  queue,  p  is  also  the 
TRAFFIC  INTENSITY. 

Consider  a  single-server  system  and  let  T  be  an  arbitrarily  long 
time  interval.  Then  the  number  of  arrivals  in  this  interval  will  be 
approximately  equal  to  AT,  by  the  law  of  large  numbers.  If  p,is  the 


probability  that  the  server  is  idle  at  some  randomly  selected  time,  then 

number  of  customers  served  during  *  *t(  1-j^/U.  with  probability  1 
xt  »T(1-p^/*-  -*y0  *  X/*4.-*1-pe  as  “T  — *«®. 

f>  ■  1-p0  •  fraction  of  time  that  server  is  busy 

The  above  results  are  true  for  general  interarrival  and  service 
time  PDFs;  in  this  case  the  single-server  queue  is  denoted  as  C/C/1 . 

In  order  to  arrive  at  tractable  models  for  communications  networks, 
restrictions  must  be  imposed  upon  the  form  of  the  interarrival  and 
service  time  PDFs.  A  common  system  employed  is  the  M/M/1  queueing 
system,  where  M  represents  the  Markovian  (or  exponential)  distribution. 

The  M/M/1  queue  is  described  later  in  this  chapter. 


3*3  Some  stochastic  processes 


Stochastic  processes  become  more  interesting  (and  certainly  easier 
to  analyse!)  if  some  structure  is  imposed  upon  the  joint  PDF. 

A  MARKOV  PROCESS  is  a  random  process  in  which  the  probability  of 
the  next  state  being  of  a  particular  type  depends  only  on  the  current 
state  and  not  upon  the  system's  past  history.  If  the  Markov  process  has 
a  discrete  state  space,  the  process  is  called  a  MARKOV  CHAIN.  We  shall 
be  interested  mostly  in  Markov  chains;  the  case  of  a  continuous  state 
space  is  the  province  of  the  diffusion  approximation  [3]. 

State  transitions  may  occur  at  any  time  for  a  continuous- time 
Markov  chain.  The  Markov  property  dictates  that  the  time  for  which  a 
state  may  remain  unchanged  is  distributed  exponentially.  In  the  case  of 
a  discrete- time  Markov  chain,  transitions  must  be  made  at  every  unit 
time;  the  Markov  property  then  dictates  that  the  time  for  which  a  state 
may  remain  unchanged  is  distributed  geometrically. 

The  BIRTH-DEATH  PROCESS  is  a  special  case  of  a  Markov  chain  where 
transitions  may  only  take  place  to  the  current  state  or  neighbouring 
states. 

A  SEMI-MARKOV  PROCESS  is  a  generalised  Markov  process  in  which  the 
times  between  state  changes  obey  an  arbitrary  probability  distribution 
(discrete  or  continuous).  A  Markov  process  can  still  be  defined  at  the 
instants  of  transition  and  is  known  as  an  imbedded  Markov  process. 

A  RANDOM  WALK  is  an  example  of  a  semi-Markov  process  in  which  we 
consider  the  motion  of  a  particle  in  a  state  space  such  that  the  next 
position  of  the  particle  is  equal  to  the  sum  of  the  previous  position 
and  a  random  variable  drawn  independently  from  an  arbitrary 
distribution.  This  distribution  does  not  depend  on  the  state  of  the 
process  except  perhaps  at  some  boundary  states;  i.e.  a  random  walk  is  a 
sequence  jsK;  n  ■  1,2,...}  which  satisfies 

■  X|  +  Xj ♦  •»•••  *  X*  (n  *  1,2,....) 

where  Sc  *  0  and  the  X{  are  Independently  drawn  from  the  same 
distribution.  The  label  n  counts  the  number  of  transitions  made.  The 
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time  intervals  between  transitions  are  of  no  interest  in  a  random  walk; 
what  is  of  interest  is  the  position  Rafter  n  transitions. 


A  RENEWAL  PROCESS  is  similar  to  a  random  walk,  but  in  this  case  the 
quantity  of  interest  is  the  distribution  of  time  between  transitions. 
Thus  S^is  now  the  time  at  which  the  nth  transition  takes  place,  and  XAis 
the  time  between  the  (n-1 )th  and  nth  transitions. 


3.4  Discrete-time  Markov  chains 


3-4.1  Introduction 

The  Markov  property  for  a  Markov  chain  lx*,}  is 

P[X(ta+l)-x^'lX(t*)-x» . X(t,)«x,]  -  PtxU.^-x^lXUJ-xJ 

where  the  rhs  is  the  (one  step)  transition  probability.  Given  the 
initial  distribution  P[x0  *j]  and  the  transition  probabilities,  we  may 
determine  the  probability  of  being  in  various  states  at  time  n. 

The  Markov  chain  is  HOMOGENEOUS  if  the  transition  probabilities  are 
independent  of  time.  We  may  then  define  the  m-step  transition 
probability 

Pi**  *  P[X„*»-  «l!X,u  «  i]  ,  (n  arbitrary  and  m«1,2,...) 

3.4.2  Homogeneous  Markov  chains 

A  Markov  chain  is  IRREDUCIBLE  if  every  state  can  be  reached  from 
every  other  state.  Define 

{«/  r 

fj  *  P[ first  return  to  Ej  occurB  n  steps  after  leaving  EyJ 

•9  ^ 

P[ever  returning  to  E:  1  2  f-  -  £  f • 

*  J  IUl 

State  Ej  is  RECURRENT  if  fj  «  1  and  TRANSIENT  if  $<1 .  If  it  is  only 
possible  to  return  to  Ej after  an  integral  multiple  of  If  steps,  then  E  is 
PERIODIC  with  period  JT  ;  if  Jf «  1 ,  then  Ej  is  APERIODIC. 

For  recurrent  states  Ej ,  we  define  the  mean  recurrence  time  of  Ejas 


If  M [j«flo  ,  Ej  is  RECURRENT  NULL;  if  Mj  <  ,  Ej  is  RECURRENT  NONNULL. 

We  now  introduce  two  important  theorems.  Let  be  the  probability 
of  finding  the  system  in  state  Ej  at  the  nth  step,  i.e. 

t>t  ■  pi*.  -  ji 

Then: 

Theorem  1  -  The  states  of  an  irreducible  Markov  chain  are  either  all 

transient  or  all  recurrent  nonnull  or  all  recurrent  null. 
If  periodic,  then  all  states  have  the  same  period  Tf . 

A  probability  distribution  P-  is  STATIONARY  if 


TT •  «  Pj  ->  TT*1  .  Pj  for  all  n. 

Theorem  2  -  In  an  irreducible  and  aperiodic  homogeneous  Markov  chain, 

the  limiting  probabilities  (equilibrium  probabilities) 

rn  -  us,  -njM 

always  exist  and  are  independent  of  the  initial  distribution. 
Moreover,  either 

(a)  All  states  are  transient  or  all  states  are  recurrent  null, 

in  which  cases  TTj  *  0  for  all  j  and  no  stationary  distribution 
exists,  or 

(b)  all  states  are  recurrent  nonnull  and  then  >0  for  all  j,  in 
which  case  the  set  {TT; }  is  a  stationary  distribution  and 

Tfj  -  1  /Mj 

In  this  case  the  TTj  are  uniquely  determined  by 
*  1  ;  TTy  •  £  TTipy 

A  state  Ej  is  ERGODIC  if  it  is  aperiodic,  recurrent  and  nonnull;  i.e. 
fj  •  1 ,  Mj  <  *»,  y  ■  1 .  If  all  states  of  a  Markov  chain  are  ergodic,  then 
the  chain  itself  is  ergodic.  Thus  a  Markov  chain  is  ergodic  if  any  of  the 
following  apply: 


lin  {TT/'I  -  {TT )  } 


(ii)  the  chain  is  finite,  aperiodic  and  irreducible 

(iii)  the  set  of  linear  equations  in  theorem  2  has  a  nonnull  solution 
for  which 

Z  iTTjl  <  **> 

Define  the  pr  obability  vector  TT  *  [TTJ,tT  ,TTJ, . ].  Then  we  may  write 

the  theorem  2  equations  as 


TT  -  Tf  P  ; 


£tT4 


(3-D 


where  P  ■  [py]  is  the  transition  probability  matrix.  There  is  a  linear 
dependence  in  the  set  of  simultaneous  equations  forTT,  so  the  probability 
conservation  condition  in  eq.(3*l)  is  needed  to  determine  the  complete 
solution. 

Ve  now  consider  the  TRANSIENT  distribution  TJ%  [nTu?....  ]. 

We  have  . ,  . 

TTW-  7Tfr^P  -  TT'V-  (n  ■  1,2, . )  (3.2) 

3«4>3  Inhomogeneous  Markov  chains 

The  results  for  a  homogeneous  chain  may  be  generalised  to  the  case 
of  an  inhomogeneous  chain,  where  the  transition  probabilities  depend  on 
tine.  Define 

Ptf  (m,n)  -  P[X»-j!X^«i] 

which  is  the  probability  that  the  system  will  be  in  state  %at  step 
n,  given  that  it  was  in  state  Ejat  step  m.  In  going  from  step  m  to  n, 
the  system  must  pass  through  some  intermediate  state  E*.  at  some 


intermediate  time  q.  Thus 


p;;  (m,n)  -  Z  P[X*- j.X^kiX,*!] 

-  Z  PtXt-klX^-i]  P[X*-;j!X.-i,X,-k] 

by  definition  of  conditional  probability.  Using  the  Markov 
property,  we  obtain  the  CHAFMAN-KOLMOGOROV  (CK)  EQUATION 

Pfj  (n,n)  ■  Z  PU  (n,q)  pfcj  (q,n)  (m  *  q  *  n)  (3*3) 

If  we  define  the  matrices  P(n)  •  [p;j(n,n+1  )]  and  H(m,n)  *  [p.j 

(m,n)],  the  CK  equation  becomes 

H(m,n)  -  H(m,q)H(q,n) 


The  FORWARD  CK  equation  is  obtained  by  setting  q*n-1 : 


H(m,n)  *  H(m,n-1 )P(n-1 ) 

(3.4) 

The  solution  is 

H(m,n)  *  P(m)P(m+1  ) . P(n-1  ) 

(3.5) 

As  an  analogy  to  the  homogeneous  case,  we  have 

TT*  **  *  'TT**,p(n)  with  solution  TT^*^  “TT<*#p (0 ) P ( 1  ) . . .  .P(n) . 


3.5  Continuous- time  Markov  chains 


The  forward  CK  equation  in  this  case  is 

}p<,-(aft)/}t  -  q  jj  ( t ) Py  ( s , t )  *  Z.  q^  (t)p;k  (s,t)  (3-6) 

where  qy  is  the  rate  at  which  the  system  moves  from  state  E;  to  Ej ,  given  that 
it '8  currently  in  E; .  We  define 

P(t)  •  [ptj  (t,t+At)j 

Q(t)  *  lim  (P(t)-I)/At  (the  transition  rate  matrix) 

H(s,t)  -  [p;j  (s,t)] 

We  may  write  the  forward  CK  equation  as  3H(s,t)/)t  *  H(s,t)Q(t),  s^t. 

The  CK  equation  for  the  equilibrium  probabilities  is 

dTTj(t)/dt  -  qjj  (t)Tlj(t)  ♦  Z  qfcj  (t)l£(t)  (3.7) 

Eq(3*6)  describes  the  probability  of  the  system  being  in  state  Ej  at  time  t, 
given  that  it  was  in  Ei  at  time  s.  Eq(3.7)  merely  gives  the  probability  that 
the  system  is  in  state  Ej  at  time  t;  information  about  the  initial  state  is 
contained  in7T(0). 

For  the  homogeneous  case,  we  have  Q(t)-*Q,  H(s,s*t)^H(t) .  The  limiting 

distribution  is  given  by 


3.6  Birth-death  processes 


3*6.1  The  Chapman -Kolmogorov  equations 

Elementary  queueing  theory  is  built  upon  the  theory  of  birth-death 
processes,  which  is  the  special  case  of  a  Markov  process  in  which  only 
the  transitions  E^-eE^and  E^E^are  allowed.  Ve  shall  now  derive  some 
properties  of  a  birth-death  process  in  the  language  of  queueing  theory. 
Consider  a  queueing  system  which  increases  or  decreases  its  population 
by  means  of  arrivals  and  departures  respectively.  Define 

\  ■  arrival  rate  when  system  contains  k  customers 

/U+  •  service  " 

In  terms  of  the  transition  rate  matrix  Q,  we  have 


q*>»<  *  K  ;  <im-<  *  /*- k 

Since  ^  p*-  (s,t)  *  1,  then  by  definition  of  Q  we  have 

j  * 

This  implies  that  q**  ■  —  (/**.+ 


Z  q«v  (t) 


Finally,  qja  ■  0  for  ' j— k ! >1  by  definition  of  the  birth-death  process. 

Ve  assume  that  the  queueing  process  is  a  homogeneous 

continuous- time  Markov  process  on  the  discrete  states  0,1,2 . .  that 

arrivals  and  departures  are  independent(i.e.  the  Markov  property),  and 

P[ exactly  one  arrival  in  (t,t*At)!k  in  system]  *  \At  ♦  o(At) 

P[ exactly  no  arrivals  in  (t,t*At)!k  in  system]  »  1  -  \At  ♦  o(At) 

Ve  obtain  two  more  equations  by  substituting  "departure"  for 
"arrival"  and  yU*for  A*..  Mote  that  we  have  assumed  that  the  probability 
of  multiple  events  is  o(At).  Define 

|(t)  ■  probability  that  system  contains  k  customers  at  time  t 

Applying  eq(3.7)  with  7J*(t)  ■  £(t),  we  have 

dPfc(t)/dt  -  -(V/*)P*(t)  *>^PH(t)  ♦/UsnWt)  .  *  »  1 

dP.(t)/dt  -  -\P,(t)  ♦/K,P,(t)  ,  k  -  0 

A  simpler  method  of  obtaining  eq(3.10)  is  to  consider  the  state- 
transition-rate  diagram  (Fig.  1).  The  equation 

(Effective  probability  flow  rate  into  E4) 

■  (Flow  rate  into  E4)  -  (Flow  rate  out  of  E4) 


immediately  yields  eq(3>10).  This  is  an  example  of  GLOBAL  BALANCE,  about 
which  more  will  be  said  later. 


3 .6.2  Poisson  arrivals 

Consider  a  pure  arrival  system  with  A{  *A  ,  0.  Then  the  solution 

of  eq(3«10)  is  , 

Pfc(t)  •  (At)exp(-At)  /  k!  , 

i.e  the  Poisson  distribution.  The  mean  and  variance  of  this  distribution 
are  both  equal  to  At,  and  G(z)  -  exp[  A  t(z-1 )]. 

Let  T  be  the  random  variable  describing  interarrival  times.  Then: 

A(t)  -  1  -  P[t>t]  -  1  -  P0(t)  -  1  -  exp(-At)  ,  t  >  0 

a(t)  *  dA(t)/dt  *  A  exp(-  Xt)  ,  t  >  0 

This  is  the  exponential  distribution  for  interarrival  times.  We  have 


E[t]  «  1/A  ;  E[(t)k]  -  2/Xk 

3.6.3  Postscript 


;  of1  -  i/A1 


It  is  a  sad  fact  that  the  solution  of  eq(3*10)  for  even  the  simplest 
interesting  queueing  system  (i.e.  M/M/1 ,  with  A;  -  A  ,  Mi  ■  /*■  )  is  far  too 
complicated  to  be  useful  [2].  The  diffusion  approximation  is  therefore 
preferable  for  axamining  dynamic  behaviour,  although  Borne  attempts  have 
been  made  to  apply  queueing  theory  to  the  transient  behaviour  of  the  M/M/1  A 
queue  [9].  The  power  of  queueing  theory  lies  in  its  ability  to  describe 
equilibrium  distributions. 


3.7  Queueing  systems  in  equilibrium 


We  now  obtain  the  general  equilibrium  distribution  for  a  single  queue. 

Let 

Pk.  »  lim  P.(t)  ,  lim  dPlt)/dt  *  0 

where  I^(t)  is  as  defined  in  eq(3.10).  Setting  A_{  p.,*  «  0  (i*1,2,... 

in  order  to  avoid  writing  the  k*0  boundary  equation  separately,  we  obtain  from 
eq(3.10)  k-i. 

Vk  *  P*  £  Ai^>i  »  *  >  0 

i*o 

~  A-l  (3.11 

pc  *  [  1  ♦  ^  TFWmu,Y  (from  conservation  of  probability) 

A*  1  »=« 

We  are  considering  equilibrium  distributions  and  thus  are  interested  only  in 
the  ergodic  case;  this  occurs  if  there  is  a  k*>  0  such  that  1  for  all 

k  >/  ke. 

We  now  consider  some  specific  queueing  systems.  Define  fiw.  A/yu.  ,  N  as 
the  average  occupancy  of  the  system,  and  T  as  the  average  system  delay. 

M  and  G  represent  the  Markovian  and  general  distributions  respectively. 

(a)  The  M/M/1  queue 

Choose  A*  ■  A ,  /U*  ■  ^4. .  For  ergodicity,  J  <  1 .  We  have 
Pk  -  (1 -/•)/**  ;  e  -  /70-/>)  ;  T  -  i/(/t-  A ) 

(b)  The  M/M/m  queue 

Choose  kk.m/l  »  JU.il  ■  k/4  (0  i  k  4.  m)  or  rn^i  (m  ^  k) 


For  ergodicity,  A/ a/i <  1.  We  obtain  Erlang's  C  formula  for  the 
probability  that  an  arriving  customer  must  join  a  queue,  i.e. 

•ft 

P[ queueing]  -  £  p*.  *  C(m,  A/m.) 

(c)  The  M/M/1 /K  queue 

We  must  "lose"  any  customers  which  arrive  when  the  system  contains  K 
customers.  Choose  A*  -  A  (k  <  K)  or  0  (k  ^K)  and  /a*  * yU- 
We  obtain 

Pfc  -  [(l-^/d-^)]/*  .  0  4k4K 

(d)  The  M/G/1  queue 

Although  the  analysis  of  a  queue  with  general  service- time  distribution 
requires  techniques  we  have  not  yet  covered,  it  is  convenient  here  to 
give  the  POLLACZEK-KHIRCHIN  FORMULA  for  the  average  occupancy  of  an  M/G/1 
queue:  (V*.  • 

N  -  p  ♦  />'{  1+tf)/2/(iy)  . 

where  ,  where  0%'  is  the  variance  of  the  service  time. 


3.8  Residual  life 


The  queueing  systems  M/G/m  and  G/M/m  are  more  difficult  to  analyse. 
Consider  the  M/G/1  system  for  example:  as  the  departures  do  not  now 
constitute  a  "memoryless"  process,  the  state  description  must  include 
the  time  since  the  most  recent  departure  as  well  as  the  number  of 
customers  in  the  system.  We  can  consider  the  set  of  departure  times  as 
defining  an  IMBEDDED  Markov  chain,  where  now  the  transition 
probabilities  are  not  merely  of  the  birth-death  type  since  many  arrivals 
may  occur  during  a  departure  period.  We  must  deal  with  the  case  of  an 
arriving  customer  finding  a  partially  served  customer  in  the  service 
facility.  We  thus  introduce  the  important  concept  of  RESIDUAL  LIFE. 
Consider  an  arbitrary  interdeparture  time  PDF 

F(x)  -  P  , 

where  tk  is  the  departure  time  of  the  kth  customer.  Then  the  pdf  is  given  by 
f(x)  *  dF(x)/dx.  Take  a  randomly  chosen  instant,  t  (Fig.  2).  The  time  T 
until  the  next  departure  is  the  residual  life,  with  PDF  ^(x)  *  P[Y<x]  and 
pdf  ^x).  Let  the  selected  lifetime  X  have  PDF  ^(x)  and  pdf  £(x).  Then 

(Probability  that  interval  of  length  x  is  chosen) 

©C  (length  of  interval)  x  (relative  occurrence  of  interval) 

i.e.  P[x<X<x*dx]  •  ^x)dx  ■  x  f(x)  dx  /  m, 

where  1/^  normalises  the  probability  and  m»  a  EfO^-tiw)*]* 

Thus: 

^x)  ■  x  f(x)  /  m,  (3.12) 

Mow  it’s  obvious  that  P[Y<y|X«xl  »  y/x  for  0£y£x. 

P[y<Y<y«-dy,  x<X{x*dx]  ■  (dy/x)  (xf(x)dx/n^  -  f(x)dydx/m, 

Integrating  wrt  x: 


18 


t£y)  -  (i-F(y))  /  b, 

We  may  use  Laplace  transforas  to  obtain  the  Boaents  of  this  distribution. 
In  particular: 

e[y]  *  b4/  2a ,  ( 


3*9  Networks  of  Markovian  queues 


3.9*1  Burke's  output  theorem 

Our  results  so  far  apply  to  single  queues.  The  question  arises  as 
to  what  relevance  queueing  theory  has  to  a  NETWORK  of  queues,  in  which 
the  output  of  one  queue  becomes  the  input  of  another. 

We  consider  an  M/M/1  queueing  system  with  Poisson  arrivals  at  rate 
-A  and  an  exponential  server  of  rate  A (Fig.  3)*  We  wish  to  find  the  PDF 
D(t)  of  the  interdeparture  time  distribution  which  feeds  the  next  node 
in  the  network.  Let  /(s),  lf(s)  and  Sts)  be  the  Laplace  transforms  of  the 
interarrival,  interdeparture  and  service  time  pdf's  respectively.  When  a 
customer  leaves  the  node,  either  a  second  customer  is  in  the  queue  or 
the  queue  is  empty.  In  the  first  case,  D(t)  is  equal  to  B(t),  so 

D^s)  j  node  nonempty  *  B^s) 

If  the  node  is  empty  after  the  first  customer  departs,  then 

(total  delay)  *  (time  until  2nd  customer  arrives) 

♦  (service  time  for  2nd  customer) 

As  the  variables  are  independent  and  identically  distributed,  the 
Laplace  transform  of  the  sum  is  equal  to  the  product  of  the  Laplace 
transforms  of  the  individual  times  (see  sections  2.2  and  2.5); 

lf(s)jnode  empty  *  A#(s)$s)  *  [  A /(s+A)][/i/(s-yp] 

For  exponential  pdf's,  the  probability  of  a  departure  leaving 
behind  an  empty  system  is  the  same  as  the  probability  of  an  arrival 

finding  an  empty  system,  i.e.  1  -p  ,  where  p  *  A//l.  Thus: 

]f(s)  ■  (1 -^)Dts)  jnode  empty  ♦  ^Dta)  inode  nonempty  ■  A  /(s+A) 

D(t)  -  1  -  exp(-At)  -  A(t) 

Thus  the  Poisson  stream  is  in  no  way  affected  by  its  passage 
through  the  node. 

It  can  also  be  shown  that  the  split  and  join  of  Poisson  streams  are 
themselves  Poisson.  These  are  important  results,  as  they  imply  that  the 
individual  queues  in  a  network  of  M/M/1  queues  Bay  be  analysed 
independently  of  one  another.  This  decomposition  is  essential  for  a 
tractable  analytic  model. 

3*9*2  Open  networks 


Consider  an  arbitrary  open  network  of  queues  with  N  nodes.  The  ith 
node  consists  of  b  exponential  servers  each  with  parameter  Ait  and 
receives  Poisson  arrivals  from  outside  the  system  at  rate  V;  •  Customers 


! 


move  from  node  i  to  node  J  with  probability  3.  or  leave  the  syatem  with 
probability 


Feedback  (i.e.  x^>0)  is  allowed. 

The  total  arrival  rate  A i  to  node  i  is  the  sum  of  the  Poiason 
external  arrivala  and  the  internal  arrivala  (which  are  not  neceaaarily 
Poisson  because  of  feedback),  i.e. 

•* 

(i  "  1  »2,....,H)  (3.15) 

or,  in  matrix  form,  A  -  *  AR,  where  A*  [A,  A*. . ,A*]. 

Each  node  must  satisfy  A>  <  my&i  for  ergodicity. 

Jackson  [lO]  showed  that  each  node  i  behaves  as  if  it  were  an  M/M/1 
system  with  a  Poisson  input  rate  ,  even  though  the  inputs  are  not 
Poisson  in  general.  Let  kfbe  the  number  of  customers  in  node  i.  Then  the 
equilibrium  probability  distribution  factors  into  the  product  of  the 
marginal  distributions,  i.e. 

p(A*A» . HA  "  pOOp^ . 1 . 

where  each  marginal  distribution  is  the  solution  to  the  M/M/m 
system.  This  result  is  known  as  JACKSON'S  THEOREM. 


3* 9- 3  Closed  networks 

A  closed  Markovian  network  contains  a  fixed  number  K  of  customers 
and  no  external  arrivals  or  departures  are  permitted.  This  constraint 
introduces  a  dependency  among  the  elements  k{Of  the  state  vector,  as 
they  must  sum  to  K.  Ry  considering  the  balancing  of  probability  flows 
(section  3*6),  Gordon  and  Newell  [ll J  proved  that 

p(k.^. . 10  -  [Goor'jf  pit  /<;oo  (3.16) 

where  *  . 

(i)  G(K)  -  4  7T  pr/  /ti(ki) 

ktA  +••  ' 

(ii)  Pi  are  defined  by  fi  ■  A i//Ai  »  where  the  A;  are  the  solutions  to 
A  *  AR  (to  within  a  multiplicative  constant). 

(iii)  *  V  (M  *i)  or  n*.!  m**“*k(kt^  m;) 

0 

(iv)  A  is  the  set  of  state  vectors  k  for  which  £  k,-  •  K. 

Consider  the  quantities  /*nj  ,  and  suppose  that  there  exists  a 
largest  ratio  ^k/m*  •  say.  Then  it  can  be  shown  that  an  infinite  number 
of  customers  will  form  in  node  k,  which  is  the  "bottleneck"  for  the 
network,  as  K*ae.  In  this  limit,  a  product-form  solution  exists  for  the 
marginal  distribution 

p(W . *kJ  “  H.( 0  H  V . 


20 


3-10  Global  and  local  balance 


The  most  general  model  to  date  of  a  product-form  queueing  network 
is  that  of  Basket t  et  al  [l2].  They  generalise  the  models  of  the 
previous  Section  to  include  different  types  of  server  and  multiple 
customer  classes.  The  four  types  of  service  centre  can  model  central 
processors,  data  channels,  terminals  and  routing  delays  respectively. 

To  obtain  the  joint  equilibrium  distribution,  we  must  solve  the 
forward  CK  equation  with  dP/dt-0,  or,  equivalently,  solve  the  global 
balance  equation 

X  P(E* )  [rate  of  flow  from  E‘  to  Ei]  ■  P(E^)  [rate  of  flow  out  of  E^]  (3*17) 

«il  Mrt 

*  for  all  states  Et*  With  a  complex  state  description  such  as  that  in 

[l2l,  the  global  balance  equations  become  difficult  to  solve.  We  can 
obtain  sufficient  conditions  for  global  balance  by  decomposing  the 
global  balance  equations  into  a  larger  set  of  smaller  LOCAL  BALANCE 
equations.  For  each  state  Eiand  node  k,  we  equate  the  rate  of  flow  into 
E{  by  a  customer  entering  node  k  to  the  rate  of  flow  out  of  E *  by  a 
customer  leaving  node  k.  Thus  each  global  balance  equation  is  a  sum  of 
local  balance  equations.  The  local  balance  method  is  used  to  determine 
the  joint  equilibrium  distribution  in  [12]:  a  discussion  of  local 
balance  is  given  in  [ 1 3 ] • 


AV. 


APPLICATION  TO  COMMUNICATIONS  NETWORKS 


4*1  Introduction 


4 .1.1  Real  networks 

A  communications  network  consists  of  a  subnet  (containing  data 
channels,  packet  buffers  and  nodal  processors)  and  hosts  which  feed 
packets  into  the  subnet.  Because  of  resource  sharing,  queues  may  build 
up  for  the  data  channels.  The  progress  of  packets  in  the  network  may  be 
governed  by  a  number  of  protocols. 

Preallocation  of  resources  (e.g.  circuit  switching)  is  a  safe  but 
wasteful  method  of  sending  messages.  Therefore  in  a  store-and-forward 
network,  only  a  channel  and  a  buffer  at  each  end  of  the  channel  are 
allocated  for  each  packet.  If  the  packet  is  successfully  received  at  the 
next  node,  an  acknowledgement  (ack)  is  sent  to  the  previous  node.  If  no 
ack  has  been  received  at  the  end  of  a  timeout  period,  the  packet  is 
retransmitted. 

The  datagram  and  virtual  circuit  subnet  services  are  now 
introduced.  The  datagram  traverses  the  network  as  an  independent  entity; 
virtual  circuit  packets  belong  to  a  "virtual  channel"  connecting  sources 
and  sinks  and  are  usually  characterised  by  the  same  routing  behaviour. 

The  efficient  utilisation  of  resources  depends  upon  the  routing 
algorithm  and  flow  and  congestion  control.  Performance  may  be  defined  by 
average  throughput  and  transit  delay. 

4.1.2  Assumptions 

In  order  to  apply  the  theory  of  product-form  queueing  networks 
[14,15],  certain  assumptions  and  approximations  must  be  made.  Adaptive 
routing,  message  priorities  and  loss  of  packets  caused  by  full  buffers 
cannot  be  treated  because  of  statistical  dependence  between  the  elements 
of  the  state  vector. 

Most  models  of  communication  networks  assume  exponential  arrivals 
and  departures.  Additionally,  Kleinrock's  INDEPENDENCE  ASSUMPTION  [3] 
must  be  invoked:  every  time  a  packet  joins  a  queue,  its  length  must  be 
redetermined  from  the  exponential  pdf  associated  with  the  service 
facility.  This  assumption  removes  the  statistical  dependence  of 
transmission  times  at  the  channels.  It  is  not  a  realistic  approximation, 
but  this  cannot  be  helped. 

If  the  average  arrival  rate  of  packets  to  a  node  is  A,  then  the 
traffic  intensity  is  given  by  fi  »A//4C»  where  C  is  the  line  capacity  of 
the  next  channel  and^At  is  the  reciprocal  mean  packet  length. 


4.1.3  Mean  end-to-end  delay  in  an  open  network  [3]  I 

1 

Let  V  be  the  total  average  traffic  rate  offered  to  the  network.  1 

This  is  split  up  among  the  various  channels  such  that  A;  is  the  average 
rate  to  channel  i  (which  has  capacity  C{).  We  may  then  define  a  traffic  1 

intensity  /0%»  A^tCtat  each  channel.  Assume  there  are  M  channels  in  the  ; 

network.  Then  the  mean  number  of  packets  in  the  network  is  equal  to  the  j 


sum  of  the  mean  queue  lengths  n,-  at  each  channel;  if  T  is  the  mean 


end-to-end  delay  for  an  arbitrary  packet,  then  by  Little's  law  the  mean 
total  number  of  packets  is  JfT.  Thus 

-  ifjrt/O-A-)  *  %  A*/(/iC i-Ai) 

is |  i*l  ' 

r'fWCj-A;) 

i  si 

Ve  may  optimise  line  capacities  by  minimising  T  wrt  the  C«,  subject 
to  some  cost  constraint.  If  the  constraint  is  linear  in  the  C%*,  then  the 
method  of  Lagrange  multipliers  may  be  used. 

The  full  distribution  for  end-to-end  delay  along  a  path  has  also 
been  evaluated  [l6].  In  particular,  the  variance  of  end-to-end  delay 
along  the  path  is 

ojJl  ■  /  >r4 

4.1.4  Closed  networks 

Closed  networks  with  product  form  may  be  used  to  model  end-to-end 
flow  control  in  a  virtual  circuit  and  perm it- oriented  (isarithmic) 
global  congestion  control.  The  evaluation  of  the  PARTITION  FUNCTION  (or 
normalisation  constant)  G(K)  in  eq(3.l6)  is  a  problem  because  of  the 
large  computer  time  and  storage  required  when  there  is  a  large  number  of 
nodes.  Another  difficulty  is  that  the  fic  are  determined  only  to  within  a 
multiplicative  constant,  so  that  incorrect  scaling  may  cause  underflow 
or  overflow. 

There  are  currently  three  approaches  to  the  calculation  of  the 
properties  of  a  closed  network:  the  convolution  algorithm  T 1 7 ] ,  the 
mean-value-analysis  (KVA)  algorithm  [l8],  and  the  integral 
representation  and  asymptotic  expansion  of  the  partition  function  [  1 9 3 • 

KVA  obtains  mean  quantities  associated  with  a  closed  chain  without 
having  to  deal  with  the  full  product-form  expression  for  the  equilibrium 
distribution.  Consider  a  closed  cyclic  chain  of  N  exponential  servers 
with  mean  service  times  /C*.  (n  *  1,2, ...,N)  and  a  fixed  number  K  of 
circulating  messages.  Define 

k*,(K)  *  mean  size  of  queue  n  (including  message  in  service) 

tK(K)  *  mean  delay  at  queue  n 
X(K)  •  throughput  of  chain 

The  mean  delay  at  queue  n  for  a  "tagged"  message  is  the  sum  of  the 
service  time  't*  for  the  tagged  message  and  the  service  times  for  the 
average  number  of  messages  in  the  system  when  the  tagged  message 
arrives.  The  ARRIVAL  THEOREM  states  that  in  a  closed  exponential  system 
the  state  seen  upon  arrival  instants  has  the  same  distribution  as  the 
equilibrium  distribution  of  the  same  closed  system  with  K-1  messages. 
Thus 

^(K)  -  X  ♦‘CJc,*(K-1 )  (n  -  1,2 . H) 

With  the  obvious  equation  k]j,(0)  ■  0,  and  the  following  expressions 
(obtained  by  the  application  of  Little's  formula  to  all  N  servers  and  to 
each  individual  server  respectively),  we  have  a  simple  recursive 


2Tt  » 

T  - 


2< 


solution  for  the  closed  exponential  system: 

X(K)  -  K  /IXdO 
k^(K)  -  A(K)^(K) 

NVA  can  be  extended  to  include  more  general  topologies  than  the 
cyclic  chain  [l8]. 

4.1.5  Homogeneous  network  models 

Networks  with  message  priorities  or  nodal  buffer  limits  contain 
statistical  dependencies  which  do  not  allow  a  product-form  solution  for 
the  equilibrium  distribution.  A  homogeneous  network  approximation  may  be 
employed,  in  which  all  nodes  are  identical  and  perform  identical 
functions.  This  implies  that  all  nodes  are  topologically  equivalent,  all 
channels  are  of  the  same  capacity,  and  all  external  offered  traffic 
rates  are  equal.  Such  models  have  been  used  to  investigate  networks  with 
priorities  [20]  and  nodal  buffer  management  schemes  [21,22]. 

4.1.6  The  range  of  application  of  queueing  theory 

The  model  defined  by  eq(4.2)  may  be  used  to  optimise  non-adaptive 
routing  algorithms.  The  use  of  closed  product-form  networks  for  the 
analysis  of  end-to-end  flow  control  and  isarithmic  congestion  control 
has  also  been  mentioned  in  this  section. 

We  may  investigate  network  components  such  as  switches  and 
point-to-point  links  by  applying  directly  local  or  global  balance 
conditions;  the  performance  of  buffer  management  schemes  and 
data-link-control  (DLC)  protocols  may  thus  be  evaluated. 


4.2  Data-link-control  protocols 


4.2.1  A  simple  model  with  window  flow  control 

Butto  et  al  [25]  consider  two  nodes  A,  B,  where  B  acknowledges 
packets  sent  by  A.  The  timeout  is  represented  by  a  feedback  to  A  of  rate 
0  ;  when  the  timeout  expires,  all  packets  in  queue  0  are  erased  from  Q 
and  placed  in  Q  for  retransmission  (Fig.  4).  The  number  of  packets  in  Q 
may  not  exceed  the  window  size,  M. 

We  assume  an  exponential  arrival  pdf  with  parameter  A  ,  and 
exponential  servers  at  nodes  A  and  B  with  parameters  o<  and  ft 
respectively.  The  model  is  inspired  by  Ref  24. 

The  state  transition  diagrams  are  given  in  Fig.  5*  The  balance 
equations  may  be  solved  by  applying  the  z-transform 

Qj(z)  -  It  ( ! z!  <  1,  o*,ia) 

J  i  mo  * 

Once  the  probabilities  have  been  obtained,  it  is  easy  to 

calculate  the  average  packet  delay  by  Little's  law: 

Average  delay  *  A*  £ 

j«o  * 

The  graph  of  this  quantity  (Fig.  6)  shows  that  the  delay  is 


sensitive  to  a  certain  range  of  window  widths. 

4.2.2  Retransmissions  and  stability  [23] 

Ve  now  investigate  the  instability  that  sets  in  when 
retransmissions  waste  the  available  resources.  Assume  an  exponential 
distribution  for  the  service  time  T,  and  let  the  timeout  duration  be  T  . 
Then  retransmission  occurs  if 

Packet  delay  W  >  T-V*  , 

where  WA  is  the  (constant)  delay  time  for  an  ack.  The  average 
traffic  rate  A  offered  to  the  channel  is  related  to  the  original  offered 
traffic  rate  A*  by  A*A0N,  where  N  is  the  mean  number  of  transmissions 
for  any  one  packet  (Pig.  7).  How, 

*  ■  I iP'  • 

where  ?■  s.  pfi  copies  sent  (including  original)] 

*  p[i-t  failures]  P[one  success] 

Now,  P[ success]  -  ?[w]  s  (i.e.  the  PDF  for  V) 

.*•  Pf  -  [1  -  #■&)]  Jjft) 

Thus:  A  -  A0li[i  -  FJX)]**1  Fj^)  -  Ac/  FJ-O  , 

where  Ac  is  the  throughput  in  steady-state  conditions. 

Using  the  standard  queueing  theory  Mpressions  for  ^(T^),  an 
implicit  equation  for  mean  packet  delay  W  as  a  function  of  APmay  be 
obtained.  The  numerical  solution  yields  the  graph  in  Fig.  8,  where  the 
instability  is  clearly  seen. 

4.2.3  The  "send  and  wait"  protocol 

We  now  introduce  a  more  general  treatment  by  Fayolle  et  al  [25]  of 
the  send  and  wait  protocol,  which  is  a  case  of  window  flow  control  with 
the  window  size  set  to  unity. 

Define  the  random  variables  X,  Y  and  Z  as  the  message  transmission 
duration  (iid  for  all  messages),  the  delay  from  the  end  of  transmission 
to  receipt  of  an  ack,  and  the  waiting  time  for  an  ack  if  timeout  T  *«o, 
respectively.  Let  L  be  the  probability  that  a  message  is  not 
acknowledged  (due  to  message  loss  or  erroneous  transmission).  Ve  may 
define  the  PDFs 

C(x)  £  P[X<x]  ,  B(x)  s  P[Y*x]  ,  A(x)  s  P[z*x]  -  B(x)(1-L)  (*<-») 

or  1  (x*  00) 

The  total  transmission  time  X  is  typically  made  up  as  in  Fig.  9*  Define 

D  ■  Pfack  not  received  before  timeout]  »  1-A(T)  *  1  -  B(T)(1-L) 

If  X*  is  a  random  variable  representing  the  total  effective 
transmission  delay  (including  all  the  "send"  and  "wait"  intervals)  for  a 
message,  given  that  it  has  to  be  transmitted  n  times  before  the  ack 
precedes  the  timeout,  then 


(4 


Ef'TfJ  -  bE[x]  ♦  (n-1  )T  ♦  (1  -D)“*  fta(t)dt 

o 

where  a(t)  is  the  pdf  of  X. 

The  terms  in  the  rhs  of  eq(4«6)  represent  respectively  the  average 
total  transmission  duration,  total  timeout  duration,  and  average  time 
before  the  ack  arrives  successfully  on  the  nth  attempt.  Note  the 
renormalising  of  the  pdf  in  the  third  term  because  of  the  restricted 
interval  (0,T). 

The  average  effective  total  transmission  duration  is  then  given  by 

E^]  ■  %  Eptk]  P[n  transmissions]  ■  3L  E[ti,]D*w(1-D)  (4 

*81  »»• 

The  timeout  which  minimises  Ef't]  can  now  be  obtained  implicitly  in 
terms  of  a(x)  and  E[xl. 

It  is  instructive  to  obtain  the  distribution  of  by  calculating 
the  Laplace  transform  i*ts)  of  the  pdf  f(x)  of 't  .  We  have 

^  -  nX  ♦  (n-1 )T  ♦  Z  (0  <  Z  <  T)  (4 

Let  JL[Q]  denote  the  Laplace  transform  of  the  pdf  of  the  random 
variable  Q.  Then  the  convolution  property  for  the  sum  of  independent 
variables  (Section  2.2)  yields 

-  £[nX]£r(n-l)T]jL[z]  (0  <  Z  <  T) 

Now,  p[nX<xl  »  p[X4x/n]  «  G(x/n) 

[nX]  ■  f exp(-sx)g(x/n)d(x/n)  -  f exp(-sy)g(y)dy  -  & sn) 

The  above  refers  to  retransmissions  of  the  same  message,  which  are 
obviously  not  independent.  If  the  durations  X  were  independent,  we  would 
have  jL[nX]  -  [/(a)]*. 

Ve  also  have 

i  [ (n-1  )T]  -  fexp(-sx)S[x-(n-l)T]dx  -  exp[-s(n-1  )t] 

and 

i.[z)  »  a(s)/(l-D)  (0  4  Z  <  T) 

Finally,  •£  ,  m 

l  fr]  ■  2.  . 

ae( 

which  may  be  differentiated  to  give  the  moments  of  the  PDF  of  T  . 

The  above  analysis  is  completely  general  and  does  not  depend  upon 
the  specific  distributions  G(x)  and  B(x).  Fayolle  et  al  then  consider 
the  effect  of  the  protocol  on  the  buffer  queue  behaviour  by  assuming  an 
exponential  arrival  process  for  G(x)  and  using  the  imbedded  Markov  chain 
approach  for  the  number  of  messages  in  the  buffer.  Results  are  given 
[25]  for  the  optimal  timeouts  under  these  conditions. 

Another  approach  to  the  analysis  of  the  send  and  wait  protocol  is 
described  by  Reiser  [8].  Both  ends  of  the  link  may  transmit  and  receive 
messages;  in  order  to  reduce  the  number  of  states  to  be  considered, 
saturated  (nonempty)  queues  are  assumed.  The  THROUGHPUT -LIMIT  THEOREM 
states  that  the  maximum  arrival  rate  leading  to  a  stationary  solution  is 
also  the  maximum  achievable  throughput;  this  implies  that  the  maximum 


throughput  aay  be  determined  without  having  to  consider  those  states 
containing  an  enpty  queue.  Because  of  saturation,  no  acks  nay  be  sent 
until  both  ends  of  the  link  are  ready,  and  so  the  acks  are  synchronised. 
The  process  is  depicted  in  Fig.  10.  TV  represents  the  state  in  which  a 
message  is  being  transmitted  over  channel  1  whilst  channel  2  is  waiting, 
etc . 

Ve  assume  that  message  transmission  rates  on  channels  1  and  2  are 
exponentially  distributed  with  parameters  /U,  ,/ta respectively;  ack  rates 
on  both  channels  are  exponentially  distributed  with  parameter/^*.  The 
state  transition  diagram  is  given  in  Fig.  10.  The  flows  from  state  TT 
deserve  explanation.  If  lx  are  exponentially  distributed  transmission 
rates  with  parameters  /Mif/txrespectively,  then  the  variable  min(  ],,],)  is 
also  exponentially  distributed  with  parameter Similarly, 

p[i#  ^3*3  -/«*/(>*.  v*a). 

Thus  the  flow  from  TT  to  TV,  for  example,  is  given  by 

(/*.♦/•)  PU,< lx]  ■  Af 

The  balance  equations  for  the  state  transitions  are  easily  solved 
to  yield  the  maximum  throughput  in  terms  of  /U.t  ,  and  . 
(Alternatively,  as  the  system  can  be  thought  of  as  a  closed  exponential 
one  with  a  single  message,  we  may  apply  the  mean  value  analysis  of 
Section  4.1  with  K*1.) 

4.2.4  The  HDLC  Protocol 

Bux  et  al  [27]  apply  a  heuristical  method  to  the  analysis  of  the 
HDLC  protocol.  The  first  two  moments  of  the  PDF  of  the  effective 
transmission  time  are  evaluated  approximately  by  making  independence 
assumptions  and  using  the  renewal  formula  (eq.  3-14)-  The  mean  transfer 
time  of  messages,  assuming  an  exponential  arrival  distribution  at  either 
end  of  the  link,  is  then  given  by  the  Pollaczek-Khinchin  formula  for  the 
M/G/1  queue  (Section  3-7). 

Labetoulle  et  al  [28]  consider  the  case  of  saturated  queues  only. 


4.3  Nodal  buffer  management 


4.3*1  Introduction 

Some  difficulties  arise  in  the  performance  evaluation  of  buffer 
management  strategies  because  the  equilibrium  probability  distribution 
for  a  queueing  network  with  finite  storage  is  unknown  at  present.  The 
standard  approach  is  to  analyse  the  behaviour  of  a  single  node  by  means 
of  queueing  theory  and  then  assume  flow  conservation  (perhaps  in  a 
homogeneous  network) . 

4.3-2  Restricted  Buffer  Sharing 

Irland  [31 ]  analyses  a  policy  in  which  R  classes  of  traffic  are 
accepted  by  R  output  channel  queues.  Each  class  r  has  exponential 
arrival  and  server  rates  with  parameters  /^respectively.  If  there  is 
a  total  of  N  buffers  in  the  node,  then  the  strategy  is  to  limit  the 
number  of  buffers  k^.  occupied  by  packets  of  class  r  to  M(£  tj). 


The  easiest  way  to  find  the  equilibrium  probabilities  is  to 
consider  the  local  balance  equations: 

P ( k,  •  •  •  ,1^  1  ,  •  •  m  A^P(i^i  •  •  •  ,1^,  •  •  •  for  r*1 1 2f  •  •  •  |R 

i 

The  solution  is  P(Jf )  »  C"' TT  pvr  (for  feasible  k  only), 

t*l  ' 


where 


A 

1  TT 

£  r»i 


and  p*  * 


The  normalisation  constant  C  is  difficult  to  evaluate  because  of 
the  restriction  on  the  states;  Irland  achieves  this  by  a  convolution 
approach.  The  nodal  blocking  probability  P[k*“M]  for  class  r  packets  can 
then  be  found  by  numerical  means;  the  optimal  value  M*of  M  which 
minimises  this  blocking  probability  turns  out  to  be 

M*  +>  N  //S' 

Irland  also  finds  the  throughput  vs.  load  behaviour  for  various 
other  strategies  such  as  "no  sharing",  with  M  *  N/R,  and  "unrestricted 
sharing",  with  M*N.  The  worst  congesion  occurs  for  the  unrestricted 
case,  as  expected.  The  behaviour  of  a  network  of  nodes  is  not 
considered. 


4.3*3  A  simple  model  with  congestion  [29] 


Before  describing  other  results  in  this  field,  it  is  useful  to 
consider  the  fundamental  model  on  which  they  are  based.  A  node  with  one 
input  and  one  output  link  has  a  finite  number  N  of  buffers;  there  are 
exponential  offered  arrival  and  departure  rates  with  parameters  A  ,/*■  . 
The  actual  throughput  Y  is  less  than  A  because  of  the  effects  of 
blocking  at  the  next  node.  Let  the  blocking  probability  be  B  (Pig.  11). 


Assume  that  the  blocking  probability  is  the  same  for  the  next  node 
in  the  network  (i.e.  a  homogeneous  network).  The  effective  utilisation ^ 
is  given  by 

P*  -  A^u./0-B) 

From  queueing  theory,  B  ■  (l-^O/^/O -f'**1)  (see  Section  3.7) 

Then  the  equation  JT  ■  A  (1-B)  is  an  implicit  one  for  X  (the 
throughput)  as  a  function  of  A (the  offered  traffic  rate).  The  solution 
yields  the  congestion  curve  of  Pig.  12.  It  must  be  noted  that  flow 
balancing  arguments  have  been  used  to  obtain  a  stationary  blocking 
probability,  although  the  system  is  not  stationary  [8]. 

4«3*4  Lam’s  model  of  a  store -and -forward  node  [30] 

Lam's  model  is  an  enhancement  of  that  given  above.  He  constructs  a 
product-  form  queueing  network  model  of  a  node,  with  different  classes 
of  traffic  routed  to  several  output  links  with  Markovian  transition 
probabilities.  Acks  and  timeouts  are  represented  by  random  delays  (i.e. 
infinite-server  "queues",  which  support  product  form).  Packets  destined 
for  node  j  are  routed  to  the  timeout  box  with  probability  Bjor  to  the 
ack  box  with  probability  1-Bj,  Bj is  thus  the  blocking  probability  at  node 
j.  The  acked  packets  are  sent  to  the  finite  buffer  pool. 

The  equilibrium  distribution  for  the  node  is  given  by  t>-  standard 


open  network  solution.  Ve  construct  a  network  approximation  by  assuming 
that  the  total  flow  into  any  service  facility  is  equal  to  the  flow  out 
of  it.  (N.B.  this  is  not  a  homogeneous  network  assumption,  as  the 
blocking  probabilities  here  are  not  assumed  to  be  the  same  for  each 
node.)  Define  the  row  vectors  as  the  throughput  and  external 

offered  traffic  rate  respectively,  and  let  P  be  the  node-node  routing 
probability  matrix.  Then  by  flow  conservation 

1  m  S  ♦  JTP  ,  i.e.  1  -  S  (I  -  £)”' 

The  actual  arrival  rate  A  (including  retransmissions)  is  given  by 
an  argument  similar  to  that  in  Section  4.2: 

f* 

Ai  *  ^Pji/O  -  *> 

Substituting  this  in  the  equation  B**  P[all  buffers  are  filled],  we 
obtain  a  set  of  nonlinear  simultaneous  equations  which  can  be  solved 
numerically  (by  the  Newton-Raphson  method,  for  example).  The  equations 
are  of  the  form 

Bf  -  fx-(2) 

The  dependence  of  B;  on  the  blocking  probabilities  Bj(jrfi)  is 
brought  about  by  the  dependence  of  the  nonnalising  constant  on  the  Bj . 

4.3*5  Input  buffer  limiting 

Lam  and  Reiser  [21 ]  embed  Lam's  model  of  a  node  in  a  homogeneous 
network  in  order  to  study  the  performance  of  an  input  buffer  limiting 
mechanism.  Ve  shall  ignore  the  nodal  processing  and  acks  with  timeout 
and  consider  only  one  outgoing  link  queue  in  order  to  concentrate  upon 
the  essential  characteristics  of  the  buffer  limiting  method. 

Two  types  of  traffic  enter  the  node:  input  traffic  from  a  local 
host  and  transit  traffic  (i.e.  that  whic  has  already  passed  through  one 
or  more  nodes)  from  the  rest  of  the  network.  The  traffic  is  considered 
to  be  exponential  with  parameters  A^and  At  for  the  input  and  transit 
traffic  respectively  (Fig.  13).  Because  of  blocking  caused  by  the  finite 
storage,  the  average  throughput  is  given  by  7%  and  ^for  input  and 
transit  traffic,  where 

7fx  -  A,(1  -  Br)  ,  2Tt  -  Vi  -  B,.) 

Bx  and  B,.are  the  blocking  probabilities  for  the  traffic  types.  In  a 
homogeneous  network,  these  blocking  probabilities  are  the  same  for  all 
nodes;  moreover 


where  IT  is  the  average  number  of  hops  traversed  by  packets  in  the 
network.  This  equation  merely  states  that  transit  traffic  is  generated 
by  input  traffic  at  other  nodes. 

In  order  to  alleviate  congestion,  we  do  not  allow  input  packets  to 
use  more  than  Hx  <N  buffers,  whereas  transit  packets  may  use  all  N 
buffers.  Bx  and  Br  may  be  found  by  an  iterative  method;  using  these 
values,  a  numerical  approach  reveals  the  following  rule  of  thumb  for  the 
value  of  the  ratio  Rj/N  which  maximises  throughput: 

Hj/H  4  (  *  1/(1  ♦U)  for  a  homogeneous  network) 


Kamoun  [22]  has  considered  a  slightly  different  buffer  limiting 
mechanism  in  which  no  input  traffic  is  accepted  if  the  total  number  of 
filled  buffers  is  equal  to  N*  (whether  filled  by  input  or  transit 
traffic).  The  choice  of  a  torus  network  allows  him  to  evaluate  n 
explicitly.  The  optimal  value  of  H*  in  the  torus  network  is  then 
calculated  by  numerical  means. 


4.4  End-to-end  protocols 


4.4.1  Introduction 

In  order  to  evaluate  the  performance  of  an  end-to-end  flow  control 
scheme  or  to  calculate  parameters  such  as  the  average  end-to-end  delay, 
a  useful  approximation  is  to  consider  the  tandem  link  (i.e.  the  set  of 
nodes  and  channels  defining  a  virtual  circuit)  in  isolation  from  the 
rest  of  the  network.  The  applications  of  open  tandem  links  to  the 
calculation  of  the  first  two  moments  of  the  end-to-end  delay 
distribution  and  of  closed  multiehain  networks  to  the  evaluation  of 
window  flow  control  are  reviewed  comprehensively  by  Lam  and  Wong 

r 14,151. 

4.4.2  End-to-end  flow  control  in  a  tandem  link 

The  most  important  model  is  that  of  Pennotti  and  Schwartz  [?2]. 

They  consider  a  tandem  link  embedded  in  a  network.  The  traffic  passing 
through  the  nodes  defined  by  the  link  may  be  classified  as  link  traffic 
and  external  traffic.  In  order  to  obtain  a  tractable  model,  we  must 
assume  that  the  external  arrivals  occur  independently  of  the  movement  of 
the  link  traffic  and  occur  independently  at  each  node  along  the  link. 

These  assumptions  decouple  the  tandem  link  from  the  rest  of  the  network, 
apart  from  the  effect  of  the  external  traffic  on  the  occupancy  of  each 
node  in  the  link.  The  tandem  link  is  shown  in  Fig.  14,  together  with  the 
link  traffic  (average  rate  \t>  )  and  the  external  arrivals  to  nodes 
1,2,....,M  (average  rate  A* ,  i»1 ,2, . . . ,M) . 

A  useful  measure  of  congestion  is  the  link-loading  factor,  L,  which 
relates  the  performance  of  each  node  without  link  traffic  to  the 
performance  when  link  traffic  exists.  Define 

T,j  *  mean  queueing  time  for  external  packets  at  node  i  in  the 

presence  of  link  traffic 

T^.  *  mean  queueing  time  for  external  packets  at  node  i  when 

there  is  no  link  traffic 

Then  L  is  defined  by 

n  ,  * 

L  -  (£  Aj  T  ZAJrti-  T.;)/T.i] 

fi  a 

■  (2  Aj  )  JT  AJ  (m{ -  m;;) /m^  by  Little’s  law 

where  m;  is  the  average  number  of  external  packets  in  node  i  in  the  presence  of 
link  traffic,  etc.  Standard  queueing  theory  yields 

*  A»/  (^-A;)  ,  there  is  no  link  traffic  in  this  case. 
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L  measures  the  link  congestion  as  the  external  packets  see  it,  but 
as  they  are  thenselvs  link  packets  (on  other  links),  L  is  a  reasonable 
■easure  of  congestion. 

The  application  of  end-to-end  control  affects  L  by  changing  the  mi . 
Let  the  window  size  be  H;  then  the  open  tandem  link  of  Pig.  14  is 
replaced  by  a  closed  chain  with  H  cycling  link  packets.  An  extra  “node" 
with  serving  rate  X*  is  introduced  as  shown  in  Pig.  15.  The  effect  of  the 
flow  control  on  external  links  (and  thus  on  the  external  average  arrival 
rates  )  is  ignored . 


Pennotti  and  Schwartz  solve  this  system  by  constructing  the  global 
balance  equation.  It  is  instructive  to  see  how  this  is  done.  The  state 
vector  is  of  dimension  2M  and  consists  of  the  numbers  of  link  and 
external  packets  at  each  node  i,  denoted  by  njand  m« respectively.  The 
number  of  link  packets  at  the  new  artificial  node  depends  on  the  numbers 
n;  (i*1 ,2, . . . ,M)  because  the  link  system  is  limited  to  H  link  packets, 
and  so  must  not  be  included  in  the  state  vector. 


into  ( 


The  global  balance  equation  [i.e.  flow  out  of  state  (n,m)  -  flow 


he  globi 
n,m)j  is 


given  by 


n  m 

[A  +2  Ui]  p(n,m) 

•  «s  |  l»r  ~ 


A.P(n,-l) 


(link  arrival  at  1,  external  arrival  at  i, 
external  departure  at  i,  link  departure  at  M) 

(link  arrival  at  1) 


♦  ifA-POni-l) 

»•« 


(external  arrival  at  i) 


♦  2L  f  (n;*1  )/(ni  +  1  *mi)>H;P(ni+1 ,0^-1  )  (link  movement  from  i  to  i+1 ) 

♦  [ (*V*+1  )/(n^1  ♦m#()/i^(P(E^'*’1 )  (link  departure  from  M) 

♦  £  [(m;+1  )/(n;  +  m;+1  )LtiP(m;+1 )  (external  departure  from  i) 

f«i  ' 

The  state  (m;-1)  is  shorthand  for  (n^, . . .  ,mj -1 , .  • .  ,ny,  •  •  •  *n/»)  • 
etc.  The  probability  of  infeasible  states  is  taken  to  be  zero;  this 
takes  care  of  the  boundary  equations.  Rote  that  a  careful  definition  of 
.the  service  rate  on  the  rha  of  the  balance  equation  is  required:  if  we 
take  the  fourth  term  on  the  rhs,  for  example,  the  effective  service  rate 
for  the  link  packets  at  node  M  is  the  original  service  rate/tf*multiplied 
by  the  ratio  of  the  number  of  link  packets  to  the  total  number  of 
packets  at  node  M.  This  partition  is  not  necessary  on  the  lhs  of  the 
balance  equation,  as  we  do  not  care  whether  a  link  or  an  external 
departure  changes  the  state  from  (g,m). 

The  solution  of  the  balance  equation  is  given  by  the  BCMP 
expression  for  a  closed  product-form  network  [12]  (although  Pennotti  and 
Schwartz  give  an  explicit  calculation).  The  blocking  probability  B  for 
the  tandem  link  is  of  course  given  by 


•  ?\  2  H]  . 

i»i 
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The  results  show  that  the  effect  of  the  external  traffic  on  the 
link  traffic  is  equivalent  to  reducing  each  service  rate  by  the 
corresponding  external  arrival  rate,  i.e.A i  •>/**;- These  adjusted 
average  service  rates  are  strictly  correct  only  for  (open  or  closed) 
product-form  queueing  networks;  nevertheless  it  is  tempting  to  apply 
them  to  models  for  which  they  are  not  really  valid  [8]. 

Another  result  of  the  model  is 

m  [ Ai )]  (1+n;)  , 

which  may  be  substituted  into  the  expression  for  the  link-loading 
factor,  L. 

The  case  of  local  congestion  control  may  be  treated  in  an 
approximate  way  (no  exact  solutions  exist  for  a  network  with  blocking). 
The  control  imposes  a  limit  of  N;  link  packets  at  each  node  i.  The 
external  traffic  is  accounted  for  by  adjusting  the  service  rates 
(although  this  is  strictly  valid  only  for  the  case  of  end-to-end 
control).  The  link  is  then  treated  as  a  series  of  independent  M/K/1 
queues,  with  the  blocking  probability  of  each  server  being 
(independently)  equal  to  the  probability  that  the  succeeding  queue  is 
full.  The  Mth  stage  is  never  blocked  and  so  the  blocking  probabilities 
for  stages  M-1 ,M-2, . . . ,1  may  be  found  in  an  iterative  way.  The 
throughput  A  is  given  by 

A  *  A,  P[ first  stage  is  full] 

Ais  required  for  the  calculation  of  the  blocking  probabilities. 

Pennotti  and  Schwartz  derive  some  numerical  results  for  a  3-stage 
tandem  link  with  all  service  rates  equal  to  /L .  They  obtain  graphs  for  L 
vs.  fa  “  ^ M'  which  show  that  both  types  of  control  become  important  in 
reducing  the  congestion  L  for  large  values  of  fa .  Optimal  control 
parameters  (such  as  the  window  size,  N)  may  then  be  selected. 

Chatter jee  et  al  [33 1  have  extended  the  above  model  to  include 
random  routing. 

4.4.3  Closed  multichain  networks 

The  Pennotti  and  Schwartz  model  of  window  flow  control  employs  the 
approximation  that  the  network  (excluding  the  tandem  link  itself)  is 
open.  Reiser  [35]  considers  a  more  reslistic  model  where  the  network 
consists  of  a  set  of  interconnecting  closed  chains  with  different  window 
sizes.  The  BCMP  solution  for  a  closed  network  applies,  but  as  usual  the 
normalising  constant  is  difficult  to  calculate  for  a  large  network. 
Reiser  instead  uses  mean- value  analysis,  as  the  arrival  theorem  applies: 
an  arriving  packet  in  a  closed  multichain  queueing  network  will  observe 
the  equilibrium  solution  of  the  network  with  one  less  packet  in  the 
arriving  packet’s  chain. 

Pujolle  and  Spaniol  [36]  make  use  of  a  simplified  version  of  the 
Reiser  model  to  assess  the  relative  performance  of  datagrams,  virtual 
circuits  and  a  hybrid  implementation  in  a  communications  subnet.  A 
geometrical  distribution  is  assumed  for  the  number  of  packets  in  a 
message.  A  virtual  circuit  with  window  size  N  is  approximated  by  N 
elementary  virtual  circuits  of  unit  window  size,  so  the  analysis  is 
simplified . 


4.4*4  Optimum  window  size 

The  preceding  models  require  numerical  analysis  for  their  solution. 
Kumar  [34]  considers  a  simple  isolated  open  tandem  link  model  in  order 
to  obtain  the  optimum  window  size  in  an  analytical  way.  The  link 
consists  of  M  nodes  with  service  rates/ti(i»1 ,2, . . . ,M) .  Kumar  takes  the 
GENERALISED  POWER  P(A)  as  his  objective  function,  where 

P(  A)  £  A*/  d(A  ) 

A  is  the  average  throughput,  D( A)  is  the  average  link  delay,  and /A 
is  an  adjustable  parameter.  This  definition  of  power  recognises  the 
trade-off  between  throughput  and  delay  that  is  characteristic  of 
queueing  systems;  the  parameter  /A  allow  us  to  decide  the  relative 
importance  of  the  two  quantities. 

As  the  link  is  of  product  form,  the  average  delays  I^(A)  at  each 
node  are  independent.  Thus  the  total  average  delay  is  given  by 

d(  A)  -  £  d4(A)  -  k  (/li-xr1 

1=1  %S I 

The  optimal  throughput  A*  which  maximises  the  power  is  then 
calculated  by  standard  methods. 

By  Little's  law,  the  average  number  N  of  messages  in  the  chain  is 

N  -  J"Ad,(A) 

is  i 

It  may  easily  be  shown  that  the  optimal  number  N*of  messages  is 
given  by  N*-  M/ft  for  the  case  where  all  service  rates  are  equal.  Kumar 
claims  that  N*  is  a  reasonable  estimate  of  the  optimal  window  size  for 
the  link. 

The  propagation  delay  caused  by  the  presence  of  a  satellite  link 
can  also  be  taken  into  account;  as  expected,  it  has  a  considerable 
effect  on  the  optimal  window  size. 

4.4.5  Two-level  control 

Finally,  the  application  of  queueing  theory  to  the  analysis  of  a 
network  containing  two  levels  of  control  [ 1 5 * 3T 1  is  worth  mentioning.  We 
consider  an  open  product-form  network  in  which  packets  are  classified 
according  to  their  source  and  destination.  The  first  level  of  control  is 
ISARITHMIC  (i.e.  the  total  number  of  packets  in  the  network  is  kept 
below  a  certain  value).  The  second  level  of  control  is  of  the  end-to-end 
type;  i.e.  the  number  of  packets  in  each  class  is  restricted. 

The  problem  is  thus  that  of  an  open  product-form  network  with 
population  size  constraints.  The  calculation  of  the  partition  function 
is  tedious  because  the  population  constraints  limit  the  number  of 
feasible  states.  The  convolution  method  obtains  numerical  results  for 
average  throughput  and  end-to-end  delay.  The  isaiithmic  control  is  shown 
to  allow  serious  degradation  in  throughput  for  other  classes  of  packet 
when  the  load  is  increased  for  any  particular  class.  The  additional 
inclusion  of  end-to-end  control  results  in  a  much  superior  overall 
network  performance. 
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5.  NETWORKS  WITHOUT  PRODUCT  FORM 


5*1  Introduction 


The  tractability  of  BCMP  type  queueing  networks  [12]  lies  in  the 
fact  that  their  joint  equilibrium  probability  distributions  are  of 
product  form,  so  that  each  queue  may  be  treated  independently  of  the 
rest  of  the  network  (apart  from  the  effect  on  the  average  arrival  rate 
caused  by  conservation  of  flow).  This  independence  is  essentially 
brought  about  by  the  adoption  of  exponential  arrival  and  departure 
processes  (although  Ref.  [ 1 2 ]  extends  this  to  certain  other  types  of 
departure  process)  which  are  considered  to  be  independent  of  each  other 
(i.e.  Kleinrock's  Independence  Assumption).  The  memoryless  property  of 
the  exponential  distribution  implies  that  we  do  not  need  to  include  (in 
the  state  vector)  the  time  elapsed  since  the  last  arrival  or  departure, 
and  thus  the  departures  from  one  queue  are  independent  of  the  arrivals 
feeding  into  the  next  queue.  (This  is  not  a  very  realistic  assumption  to 
make  for  a  communications  network,  but  the  analysis  would  otherwise  be 
too  difficult.) 

The  above  discussion  leads  us  to  believe  that  the  presence  of 
adaptive  routing,  nodal  blocking  and  message  priorities  will  destroy  the 
product  form,  as  they  all  introduce  strong  state  dependencies  between 
the  queues.  In  addition,  any  form  of  congestion  control  in  a  real 
network  will  result  in  the  buffering  of  blocked  packets  outside  the 
network  until  later.  As  this  destroys  the  Markov  property,  this 
situation  cannot  be  handled  analytically  either.  The  equilibrium 
distributions  of  networks  possessing  any  of  these  characteristics  cannot 
(as  yet)  be  obtained  in  closed  analytical  form. 

This  chapter  describes  attempts  to  analyse  exactly  networks  with 
blocking  and  message  priorities. 


5.2  Blocking  in  networks 


5.2.1  Introduction 

Chapter  4  contained  various  models  in  which  the  concept  of  blocking 
was  treated  in  an  approximate  way.  We  concentrate  in  this  section  upon 
exact  analysis  of  simpler  systems. 

5.2.2  A  simple  cyclic  queueing  system 

Gordon  and  Newell  [38]  consider  a  closed  tandem  link  with  M 
exponential  servers  of  average  rate At  and  a  finite  maximum  queue  length 
of  size  m*(i"1 , 2,...,M).  The  closed  system  contains  N  cycling  customers. 
If  the  number  ru#  of  customers  at  the  (i*1)th  stage  is  such  that  nj*  • 
m«w,  then  the  ith  server's  operation  is  suspended  until  a  customer  at 
stage  i+1  has  completed  service. 

The  global  balance  equation  for  the  system  is 


JT  >;€»*  ( n; )  $t>,  ( n*, )  P  ( n ) 
l«i 


jT>«jfc(nj)6,>,(n^,)P(iy...fn;+1  .n^-1  .*..,11,,) 


where  *  (n*)  -  ,  *>;)  -  J  /  fc. 

and  ^  n^  *  N. 

I*/ 

The  case  M*2  is  exactly  solvable.  The  equilibrium  probability 
distribution  may  be  denoted  by  IJ(n,  )  (as  n^is  not  an  independent 
variable) .  The  minimum  and  maximum  values  of  n,  are  given  by 


max(0,N-m2) 


kg  -  minCN.m, ) 


Thus  the  number  of  possible  states  is  R  *  1+^-k|  .  The  global  balance  equations 


(/*-y«i)P((n)  *  /t|P,(n+1 )  ♦  yM»P(n-1  ) 
y».P,(k ,♦!)  -  /«.P,Og 


for  k,  ♦  1  <  n  <  kx 
for  n  *  k/+  1 


The  solution  is 


where 


P/n)  -  (A/^r^PtOO 


W  .  [£  (WA)"4]"' 

**A» 


(  /?"'  1/  /*  V** 


For  the  case  N  >  and  yu.,  4  /li  ,  we  see  that  the  first  stage  must 

always  contain  at  least  k/>0)  customers,  so  the  mean  throughput  A  is 

A  -  /*»  Pfiigi*  m*]  -  /i.  [  1  -  P.OOl 

Gordon  and  Newell  also  present  an  approximate  solution  for  the 
general  case  with  an  arbitrary  number  of  servers. 

^.2.3  A  two-stage  network  with  feedback  and  blocking 

Konheim  and  Reiser  [24]  have  formulated  a  model  which  reflects  the 
characteristics  of  a  concentrator-processor  combination.  Packets  queue 
at  the  concentrator  and  are  then  sent  to  the  main  processor,  which  has  a 
small  buffer  (Fig.  16).  When  this  buffer  is  full,  the  concentrator  stops 
polling  the  input  lines. 

Let  i,j  be  the  number  of  packets  queued  at  the  concentrator  and 
processor  respectively  (Fig.  16).  The  buffer  in  the  processor  can 
accommodate  a  maximum  of  M  packets;  when  it  is  full,  the  concentrator  is 
blocked.  The  feedback  is  represented  by  an  independent  probability© 
that  the  packet  is  returned  to  the  concentrator  queue. 

The  state  transition-rate  diagram  is  given  in  Fig.  17.  To  solve  the 
global  balance  equation  we  introduce  the  z-transform 


/  P,v  •*  . 

t*0  * 


0  N<  i  4  H  and  \z]  4  1 


This  transforms  the  linear  system  of  balance  equations  into  an 
equivalent  linear  system  in  tridiagonal  form  which  relates  the  functions 
\¥  z)j.  Unfortunately  this  simple  system  still  requires  a  numerical 
solution.  An  analytical  solution  in  closed  form  is  available  only  for 


the  case  M*1 


5.3  Priority  in  networks 


5 - 3- 1  Introduction 

Networks  with  message  priorities,  like  those  with  blocking,  do  not 
satisfy  the  local  balance  requirements  and  thus  do  not  have  product-form 
solutions.  Kleinrock  [3]  describes  the  calculation  of  the  average 
waiting  time  at  a  single  M/M/1  queue  with  priorities.  As  with  blocking, 
the  only  exact  solution  for  a  priority  network  is  for  a  two-node 
network. 

5.3.2  Priority  in  homogeneous  networks  [20] 

Ve  consider  an  open  network  consisting  of  N  nodes  with  exponential 
service  rates  Aj  U-1.2,...  ,N)  and  P  preemptive  priority  classes. 
Exogeneous  Poisson  streams  of  priority  class  i  arrive  at  node  j  with 
mean  rate  Xi (i-1 , . . . ,P;  j*1,...,N).  Class  i  is  of  higher  priority  than 
class  k  if  i>k.  The  routing  is  governed  by  a  probability  matrix  which  is 
the  same  for  all  priority  classes. 

Let. the  solutions  of  the  traffic  equations  (section  4.3.4)  be  je}|, 
where  e)  is  the  mean  arrival  rate  of  class  i  packets  to  node  .j .  For 
stability  we  must  have 

P 

<£  €}  <  Mi  . 

1*1  ' 

The  state  is  defined  by  |nj},  where  n j  is  the  number  of  class  i 
packets  at  node  j.  We  define  the  aggregate  state  variable  m,-by 

'  . 

m;  *  nj  ■  number  of  packets  of  class  i  or  higher  at  node  ,7 


now, 

Efnj]  -  E T mj  1  - 

The  mean  delay  (including  service  time)  D)  is  given  by  Little's  law: 

D;  *  Efn}]/ej  -  IeT ra‘- 1  -  Efm^*]}  /  e) 

In  a  homogeneous  network,  the  service  rate  and  the  routing  are 
assumed  to  be  the  same  for  all  priority  classes.  ^Thus  the  {m}|  are  the 
same  as  would  be  obtained  in  a  network  where  Xj  ■  0  (1<k<i)  and  all 
remainihg  priority  distinctions  ignored.  This  network  is  of  product  form 
and  ao  we  may  use  the  familiar  M/M/1  formula  TT  *  A/(^«C  -  A  )  for  each 
queue :  ^ 

"  £  ei  >  to  •;> 

Defining  fa  ■  ej/'fij  ,  we  then  have 


d]  •  Aft  0  -£/»;  )  /  (1  -k  fa  ) 


This  expression  is  applicable  only  if  routing  and  service  time 
distribution  are  the  same  for  all  priority  classes. 
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5*3*3  An  exact  two-node  inhomogeneous  solution  [20] 

The  model  is  of  a  full-duplex  data  link  which  transmits  two  grades 
of  messages  (i.e.  high  and  low  priority)  under  a  window  flow  control 
protocol.  High-  priority  messages  (and  their  acks)  have  preemptive 
priority  over  their  low-  priority  counterparts.  The  system  is  shown  in 
Fig.  18. 

Under  exponential  assumptions  the  state  transition- rate  diagram  for 
the  system  is  given  by  Fig.  19  (for  the  case  N“3,  M*2).  The  rate  diagram 
depicts  the  following  information.  For  0<n<N,  changes  in  m  cannot  occur. 
If  n*0,  then  m  may  decrease  at  node  A;  it  cannot  increase  because  no 
low-priority  message  can  be  transmitted  from  node  B.  The  converse 
argument  applies  for  n*N.  Morris  [20l  solves  the  balance  equations  for 
this  system.  The  mean  delay  for  each  class  of  message  may  then  be  found 
from  the  p(n,m)  and  Little's  law. 


Fig.  18 


Two-  node  priority  network  (Section  5.3*3) 


Fig.  1? 


State  transitions  for  priority  network  (Section  5-3.3) 


6.  CONCLUSIONS 


Most  of  the  effort  in  the  analytical  performance  evaluation  of 
communications  networks  has  been  restricted  to  the  solution  of  the 
equilibrium  system  by  means  of  queueing  theory  or  (more  fundamentally) 
the  theory  of  Markov  processes.  This  theory  provides  good  results  for 
models  of  data  links  and  other  small  systems,  but  is  less  accurate  for 
large  networks  because  of  the  approximations  necessary  to  preserve 
product  form.  One  approximation  technique  which  leads  to  the  analysis  of 
networks  with  general  arrival  and  service  distributions  is  decomposition 
[39].  The  diffusion  approximation  f 3 1  is  a  useful  tool  for  the  analysis 
of  transient  behaviour.  As  it  is  most  unlikely  for  a  communications 
network  to  attain  equilibrium,  transient  behaviour  is  extremely 
important.  Queueing  theory  is  not  a  suitable  framework  for  this  sort  of 
analysis,  as  the  time-dependent  solution  of  even  the  simple  M/M/1  queue 
is  so  complex  as  to  be  useless  [3]* 

Some  attempts  [40]  have  been  made  to  analyse  optimal  control  and 
adaptive  routing  in  communications  networks.  As  in  queueing  theory, 
various  unrealistic  simplifications  have  to  be  made  before  the  model  is 
tractable. 

In  summary,  queueing  theory  has  so  far  been  the  most  important 
method  for  the  analysis  of  network  behaviour.  The  next  steps  will 
probably  be  in  the  following  fields: 

(i)  Approximate  analytical  methods  (such  as  decomposition)  for  the  performance 

evaluation  of  more  realistic  models. 

(ii)  The  almost  unexplored  area  of  transient  behaviour. 

The  need  for  such  methods  has  never  been  more  pressing. 
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The  application  of  queueing  theory  to  the  performance  analysis  of  store- 
and-forward  communications  networks  is  described.  Some  basic  definitions  snd 
results  in  probability  theory  are  reviewed,  and  the  important  concept  of  the 
Markov  and  queueing  theory  to  the  study  of  networks  and  network  components  in 
equilibrium  are  taken  from  a  wide  range  of  recent  research  literature,  with  the 
emphasis  placed  upon  the  formulation  of  the  mathematical  model,  rather  than  its 
solution. 

The  author  feels  that  this  Review  should  prove  invaluable  to  mathematicians  who 
wish  to  gain  an  appreciation  of  the  power  (and  limitations)  of  an  analytical 
technique  that  occupies  an  important  position  in  current  communications  research. 
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